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Ground states of three-dimensional EA Ising spin glasses 
are calculated for sizes up to 14"^ using a combination of a 
genetic algorithm and cluster-exact approximation. For each 
realization several independent ground states are obtained. 
Then, by applying ballistic search and T = Monte-Carlo 
simulations, it is ensured that each ground state appears with 
the same probability. Consequently, the results represent the 
true T = thermodynamic behavior. The distribution P{\q\) 
of overlaps is evaluated . For increasing size the width of P ( | g | ) 
and the fraction of the distribution below qo = 0.5 converge 
to zero. This indicates that for the infinite system P(|(7|) is 
a delta function, in contrast to previous results. Thus, the 
ground-state behavior is dominated by few large clusters of 
similar ground states. 

Keywords (PACS-codes): Spin glasses and other 
random models (75.lQ.Nr), Numerical simulation studies 
(75.40.Mg), General mathematical systems (02.1Q.Jf). 



I. INTRODUCTION 

Recently, a new algorithm for studying the ground- 
state landscape of finite-dimensional spin glasses |l|] was 
introduced M. It could be shown that this method is 
indeed able to calculate true ground states ^. The ±J 
spin glass (see below) exhibits a ground-state degener- 
acy, i.e. many different ground states exist for each re- 
alization. Results M describing the distribution of the 
ground states depend on the statistical weights of the 
states which are determined by the algorithm which is 
used. Usually, different ground states exhibit different 
weights g, which is thermodynamically incorrect. Here, 
a new technique is applied which avoids this problem. 

In this work, three-dimensional Edwards-Anderson 
(EA) ±J spin glasses are investigated. They consist of 
N spins (Ti — ±1, described by the Hamiltonian 
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The sum runs over all pairs of nearest neighbors. The 
spins are placed on a three-dimensional (d=3) cubic lat- 
tice of linear size L with periodic boundary conditions in 



all directions. Systems with quenched disorder of the in- 
teractions (bonds) are considered. Their possible values 
are Jij = ±1 with equal probability. To reduce the fluc- 
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tuations, a constraint is imposed, so that ^/ 

One of the most important questions is whether many 
pure states exist for realistic spin glasses. For the in- 
finitely ranged Sherrington-Kirkpatrik (SK) Ising spin 
glass this question was answered positively by the contin- 
uous replica-symmetry-breaking mean-field (MF) scheme 
by Parisi m. But also a complete different model is pro- 
posed: the Droplet Scaling (DS) theory 0-|ll[ suggests 
that only two pure states (related by a global flip) ex- 
ist and that the most relevant excitations are obtained 
by reversing large domains of spins (the droplets). From 
the ground state point of view the existence of many pure 
states means that two ground states may differ by an ar- 
bitrary number of spins. Otherwise two ground states 
would only differ by the spin orientations in some finite 
domains, which is always possible in the ±J model be- 
cause of the discrete structure of the interaction distri- 
bution. A detailed discussion can be found in |T^ , where 
the metastate approach iQ is used to thoroughly analyze 
MF,DS and other intermediate scenarios. 

While earlier Monte-Carlo (MC) simulations ||l4[| s uffer 
from small system sizes or equilibration problems ]15|] , re- 
cent results of simulations |l6| at temperatures just below 
Tc seem to find evidence for the MF picture. In [O, by 
applying a Migdal-Kadanoff approximation, MF behav- 
ior was found for small systems at temperatures slightly 
below Tc, where the correlation length exceeds the system 
size. But by going to lower temperatures or larger sys- 
tems the DS picture turned out to be more appropriate. 
Consequently, the analysis of true ground states should 
clarify the issue. In lia] ground states were calculated 
using multicanonical MC sampling, but no discrimina- 
tion between MF and DS could be made because of too 
small system sizes. Using cluster-exact approximation 
true ground states 0] were studied and MF behavior was 
found Q. But, as mentioned at the beginning, these re- 
sults suffer from the fact that not all ground states are 
generated with the same probability |q|. This would in- 
deed be the correct sampling method, since all ground- 
state configurations have exactly the same energy. 

In this work ground states of sizes up to L = 14 are cal- 
culated and a technique is applied, which guarantees that 
all ground states enter the result with the same weight, 



i.e. the correct T = thermodynamical behavior is ob- 
tained. It will be shown that the main result changes dra- 
matically: with increasing system size the ground-state 
behavior is not explained by the MF scenario. 

The method presented here is not only useful when 
the ground state calculation is performed using cluster- 
exact approximation. Also other methods like simulated 
annealing or multicanonical simulation do not guarantee 
a priori that each ground state is calculated with the 
same probability because always a finite number of steps 
is used. Thus, the technique presented here has a wide 
range of applications. 

The paper is organized as follows: next a short descrip- 
tion of the algorithms is presented. Then the definitions 
of the observables evaluated here are shown. In the main 
section the results are presented and finally a summary 
is given. 



II. ALGORITHMS 

The calculation of ground states for three-dimensional 
spin glasses belongs to the class of the NP-hard problems 
||19| , i.e. only algorithms with exponentially increasing 
running time are available. Thus, only small systems can 
be treated. The basic method used here is the cluster- 
exact approximation (CEA) technique B , which is a dis- 
crete optimization method designed especially for spin 
glasses. In combination with a genetic algorithm [ p0|j2l| 
this method is able to calculate true ground states TS] 
up to i = 14. Using this technique one does not en- 
counter ergodicity problems or critical slowing down like 
when using algorithms which are based on Monte-Carlo 
methods. 

But, as mentioned before, by applying pure genetic 
CEA, one does not obtain the true thermodynamic dis- 
tribution of the ground states |Q, i.e. not all ground 
states contribute to physical quantities with the same 
weight. For small system sizes up to i = 4 it is possible 
to avoid the problem by generating all T = states, i.e. 
averages can be performed simply by considering each 
ground-state once. Since the ground state degeneracy 
increases exponentially with the number N of spins, this 
is not possible for larger system sizes. Instead one has to 
choose a subset of all configurations. The following pro- 
cedure is applied to ensure that all ground states appear 
with the same probability in this selection: 

By performing the ballistic-search (BS) algorithm p^ ] 
the ground states are grouped into clusters. All states 
which are accessible via flipping of free spins, i.e. with- 
out changing the energy, are considered to be in the same 
cluster. It has been shown |^ that the number of clus- 
ters defined in this way diverges exponentially for the 
three-dimensional ±J spin glass. The sizes of these clus- 
ters can be estimated quite accurately using a variant of 
the BS method |g2[ even if only few ground states per 
cluster are available. Then a certain number of ground 



states is selected from each cluster. This number is pro- 
portional to the size of the cluster. It means that each 
cluster contributes with its proper weight. The selection 
is done in a manner that many small clusters may con- 
tribute as a collection as well; e.g. assume that 100 states 
are used to represent a cluster consisting of 10^° ground 
states, then for a set of 500 clusters of size 10^ each a 
total number of 50 states is selected. This is achieved by 
sorting the clusters in ascending order. The generation 
of states starts with the smallest cluster. For each cluster 
the number of states generated is proportional to its size 
multiplied by a factor /. If the number of states grows 
too large, only a certain fraction /2 of the states which 
have already been selected is kept, the factor is recalcu- 
lated (/ ^- f * f2) and the process continues with the 
next cluster. 

The states representing the clusters are generated by 
T = Monte-Carlo simulation, i.e. iteratively spins 
are selected randomly and fiipped if they are free. The 
ground states which have been obtained before are used 
as initial configurations for the MC simulation. MC is 
able to reproduce the correct thermodynamic distribu- 
tion, if the simulation time is long enough. Then, all 
ground-states within a cluster are visited with the same 
frequency. Later it will be shown that for the largest size 
L = 14 and the largest clusters 100 MC steps per spin 
are sufficient. 

Since each cluster appears with a weight proportional 
to its size and each ground state within a cluster appears 
with the same probability, on total each ground state has 
the same likelihood of being generated. Thus, the correct 
thermodynamic distribution is obtained. 



III. OBSERVABLES 

For a fixed realization J = {Jij} of the exchange in- 
teractions and two replicas {cf }, {cf }, the overlap ||] is 
defined as 
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The ground state of a given realization is characterized 
by the probability density Pj{q). Averaging over the 
realizations J, denoted by [-Jatj, results in {Z = number 
of realizations) 
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Because no external field is present the densities are sym- 
metric: Pj{q) = Pj{—q) and P{q) = P{—q). Therefore, 
only -P(|<z|) is relevant. 

The Droplet model predicts that only two pure states 
exist, implying that P{\q\) converges to a delta function 
P{q) = 6{q — qEA) for L — > cxo (we don't indicate the L 
dependence by an index), while in the MF picture the 



density remains nonzero for a range < q < qi with a 
peak at qmax (0 < 9max < 9i ) • Consequently the variance 
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stays finite for L ^ cxd in the MF pictures while CT^(|g|) ~ 
L^y -^ according the DS approach. The combined 
average of a quantity X over all ground states and over 
the disorder is denoted with X. Here, y is the zero- 
temperature scaling exponent denoted 6 in |||,|l^ . 

To characterize the contribution from small overlap 
values separately, which are due to a complex structure of 
the energy landscape, the weight Xqg of the distribution 
below a given threshold go is calculated: 
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The overlap defined in (0) can be applied to measure 
the distance cP^ between two states: 
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with < (P^ < 1. For three replicas a,/?, 7 the usual 
triangular inequality reads d"^ < d"'' + d"^^ . Written in 
terms of q it reads 
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Another characteristic attributed to the MF scheme is 
that the state space exhibits ultrametricity. In an ultra- 
metric space p3| the triangular inequality is replaced by 
a stronger one d"'^ < max(d"''', d''^) or equivalently 
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An example of an ultrametric space is given by the set 
of leaves of a binary tree: the distance between two leaves 
is defined by the number of edges on a path between the 
leaves. 

Let qi < q2 < qa be the overlaps q"'^ , q"^ , q'^^ ordered 
according their sizes. By writing the smallest overlap on 
the left side in equation (g), one realizes that two of the 
overlaps must be equal and the third may be larger or 
the same: 91 = 92 < 93- Therefore, for the the difference 



Sq^q2- qi 



(9) 



6q = holds. For a finite system ultrametricity may be 
violated, i.e. Sq > 0. If a system becomes more and more 
ultrametric with growing system size, Sq should decrease 
while L — > 00. When evaluating Sq, the influence of the 
absolute size of the overlaps should be excluded. Thus, 
the third overlap is fixed: q^, = qfix- In practice overlap 
triples are used where (73 G [qfix, qfix2] holds. This allows 
to obtain sufficient statistics. In the next section the dis- 
tribution P{5q) is evaluated. For an ultrametric system 
this quantity should converge to a Dirac delta function 
with increasing size L p4|. 



IV. RESULTS 

Ground states were generated using genetic CEA for 
sizes L G [3, . . . , 14]. The number of realizations of the 
bonds per lattice size ranged from 100 realizations for 
L = 14 up to 1000 realizations for L = 3. One L = 14 
run needs typically 540 CPU-min on an 80MHz PPC601 
processor (70 CPU-min for i = 12, . . ., 0.2 CPU-sec 
for i = 3), more details can be found in 0. Each run 
resulted in one configuration which was stored, if it ex- 
hibited the ground state energy. For the smallest sizes 
L = 3,4 all ground states were calculated for each real- 
ization by performing up to 10^ runs. For larger sizes it 
is not possible to obtain all ground states, because of the 
exponentially rising degeneracy. For L = 5,6,8 practi- 
cally all clusters are obtained using at most lO'' runs [ p2| , 
only for about 25% of the L = 8 realization some small 
clusters may have been missed. 

For L > 8 not only the number of states but also the 
number of clusters is too large, consequently 40 indepen- 
dent runs were made for each realization. For L = 14 
this resulted in an average of 13.8 states per realization 
having the lowest energy while for L = 10 on average 
35.3 states were stored. This seems a rather small num- 
ber. However, the probability that genetic CEA returns a 
specific ground state increases (sublinearly) with the size 
of the cluster the state belongs to [^. Thus, ground 
states from small clusters do appear with a small proba- 
bility. Because the behavior is dominated by the largest 
clusters, the results shown later on are the same (within 
error bars) as if all ground states were available. This 
was tested explicitly for 100 realizations of L = 10 by 
doubling the number of runs, i.e. increasing the number 
of clusters found. 

Using this initial set of states for each realization 
(L > 4) a second set was produced using the techniques 
explained before, which ensures that each ground state 
enters the results with the same weight. The number of 
states was chosen in a way, that rimax = 100 states were 
available for the largest clusters of each realization, i.e. a 
single cluster smaller than one hundredth of the largest 
cluster does not contribute to physical quantities, but, 
as explained before, a collection of many small clusters 
contributes to the results as well. Finally, it was verified 
that the results did not change by increasing rimax- 

The number of MC steps used for generating the states 
was determined in the following way: a ground state was 
selected randomly from the largest clusters found for the 
L = 14 realizations. 100 independent T = MC runs 
of length Hmc MC steps were performed starting always 
from this initial state. For the set of 100 final states the 
distribution of overlaps was calculated. The whole pro- 
cess was averaged over different realizations. In Fig. |l| 
the average distribution Pc{q) of overlaps is shown for dif- 
ferent run lengths nj^ic ■ It can be seen that by increasing 
the number of MC steps the ground-state cluster is ex- 
plored better. By going beyond umc — 100 steps Pc{q) 



does not change, indicating that this number of MC steps 
is sufficient to generate ground states equahy distributed 
within a cluster for L — 14. 

The order parameter selected here for the description 
of the complex ground state behavior of spin glasses is 
the total distribution P(|g|) of overlaps. The result for 
the case where all ground states have the same weight 
is shown in Fig. || for L = 6, 10. The distributions are 
dominated by a large peak for q > 0.8. Additionally there 
is a long tail down to q = 0, which means that arbitrarily 
different ground states are possible. So far this is the 
same result as obtained earlier Q for the case where the 
weights of the states are determined by the genetic CEA 
algorithm. But there is a difference: for the old results 
the weight of the long tail remains the same for all system 
sizes. Here for L = 10 small overlaps are about 3/4 times 
less likely than for L = 6. 

To study the finite size dependence of this effect, the 
variance cr^ (jgl) of P(|g|) was evaluated as a function of 
the system size L. The result is displayed in Fig. |[ Ad- 
ditionally the datapoints from |j] are given. Obviously, 
by guaranteeing that every ground state has the same 
weight, the result changes dramatically. To extrapolate 
to L — > cxD, a fit of the data to aj^ = a^ + aoL""^ was 
performed. A value of ct^ = -0.01(1) (ai = -0.61(15)) 
was obtained, indicating that the width of Pd?]) is zero 
for the infinite system. Consequently, the MF picture 
with a continuous breaking of replica symmetry cannot 
be true for three-dimensional ± J spin glasses. 

In Fig. Q the behavior of the long tail is studied in 
more detail. The integrated weight Xq.s (L) of all overlaps 
q < qo = 0.5 is shown as a function of the system size. 
Again a fit is used to extrapolate the behavior of the 
infinite system. A value of X^o = —0.01(2) is obtained, 
confirming the result obtained above. 

One might suspect that the results can be explained 
by the fact that with increasing system size the behavior 
is dominated more and more by one ground-state cluster. 
To examine this issue the quantity Y — I — [J^c'^clav is 
calculated, where Wc is the relative size of cluster c. If 
really one cluster dominates, Y must vanish with increas- 
ing system size L. In Fig. y is shown as a function of L 
for small system sizes L < 8, where all ground-state clus- 
ters have been obtained. Obviously, Y does not decrease. 
One reason is that the probability P{nc = 1) that a re- 
alization exhibits just one ground-state cluster (and its 
inverse) decreases with growing system size (cf. inset). 
Consequently, there is no single reason explaining the be- 
havior of P(|(7|). Additionally, for the interpretation of 
Fig.^, one has to take into account that the definition of a 
cluster, although it is very useful for the evaluation of the 
ground-state landscape, may have no physical meaning. 

By collecting all results one obtains the following de- 
scription for the distribution of overlaps of the infinite 
system: It consists of a large delta-peak and a tail down 
to 5 = 0, but the weight of that tail goes to zero. This 
expression is used to point out that by going to larger 
sizes small overlaps still occur: the number of arbitrarily 



different ground states diverges |g^ . But the size of the 
largest clusters, which determine the self overlap leading 
to the large peak, diverges even faster. The delta-peak is 
centered around a finite value qsA- From further evalu- 
ation of the results qsA — 0.90(1) was obtained. 

Finally, it was tested whether the ground states are ul- 
trametrically organized. In Fig. @ the distribution P{Sq) 
is shown for system sizes L = 4, 8, 12. Each realization 
enters the distribution with the same weight. With in- 
creasing system size the distributions get closer to q = 0, 
indicating that the systems become more and more ul- 
trametric. The same conclusion can be driven from the 
evaluation of the average value of Sq as a function of L 
(cf. inset). This result is similar to the former calcula- 
tions g, where the correct T = distribution was not 
obtained. But it should be stressed that ultrametricity 
is only found within a restricted subset of states (here 
53 « 0.5). By performing the thermodynamic linnt the 
weight of all regions of state space restricted in this way 
disappears, i.e. ultrametricity disappears as well. 



V. CONCLUSION 

Using genetic cluster-exact approximation the ground- 
state landscape of three-dimensional ± J spin glasses is 
investigated. By applying ballistic search and T = 
Monte-Carlo simulation it is guaranteed that each ground 
state enters the result with the same probability, thus 
a correct thermodynamic distribution is achieved. This 
technique also can be successfully combined with other 
methods which are used to generate several configura- 
tions from a degenerate ground-state landscape, e.g. with 
simulated annealing or multicanonical simulation. 

The distribution of overlaps is evaluated. For the in- 
finite system it consists solely of two symmetric delta- 
peaks. This does not imply that there are only two 
ground-state clusters remaining. On the contrary, the 
number of ground state clusters grows exponentially with 
increasing system size but the ground-state behavior is 
dominated by a few large similar clusters (and their in- 
verse). Therefore, a distinct impression emerges: a huge 
number of arbitrarily different ground-state clusters ex- 
ist, but by going to larger and larger sizes most of them 
become unimportant. This rules out any (nonstandard) 
MF picture with continuous breaking of symmetry to be 
valid in total. Interestingly, the result is compatible with 
the one step replica-symmetry-breaking scheme which 
was observed for the p-spin glass |g^ . It exhibits a simple 
distribution of overlaps while many different ground-state 
clusters are possible. However, further work is needed to 
determine which of the remaining scenarios really holds 
for finite-dimensional spin glasses. 

Please note that the cluster-interpretation depends on 
the definition of a cluster. By choosing a dynamic which 
allows flips of more than one spin at a time, a different 
definition of energy-barriers is implied and thus another 



kind of clusters. But it should be stressed that the results 
presented in this work do not depend on the way a cluster 
is defined. Any method of sorting the ground states into 
groups will work that takes the number of ground states 
selected proportional to the size of the group, and ensures 
that each state of a group has the same probability of 
being used for the calculation. 

Finally, it should be pointed out that not all results 
previously obtained using genetic CEA are biased by the 
disbalance of the ground-state distribution. The main 
outcomes in P,p^ are not affected. Additionally, al- 
though the old data bases on a wrong distribution, the 
results in B prove that there are arbitrary different clus- 
ters present. The reason for P{\q\) -^ S{q — qea) is that 
most of them become less important. 
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FIG. 1. Distribution Pc{q) of overlaps restricted to a 
ground-state cluster for different number umc of MC steps. 
100 independent T = MC runs were performed for the 
largest clusters found for L = 14 starting always from the 
same ground state. By going beyond umc = 100 the dis- 
tribution does not change any more, indicating that 100 MC 
steps are sufficient to obtain independent ground states within 
a cluster for L < 14. The inset shows the mean overlap value 
as a function of umc ■ 
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FIG. 2. Distribution P(\q\) of overlaps for L = 6, 10. Each 
ground state enters the result with the same probability. The 
fraction of small overlaps decreases about a factor 3/4 by 
going from L = 6 to L = 10 (please note the logarithmic 
scale) . 



FIG. 4. Fraction of the distribution of overlaps below 
go = 0.5 as a function of linear system size L. Here the 
results for the correct thermodynamic average is shown. The 
line represents a fit to Xo.5{L) — Xoo + xqL^^ . The extrapo- 
lation L ^ oo results in Xoo = —0.01(2), i.e. for the infinite 
systems small values of \q\ occur with frequency zero. 
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FIG. 3. Variance (T^(|g|) of the distribution of overlaps 
as a function of linear system size L. The upper points 
show the case were each ground state enters with a weight 
determined by the genetic CEA algorithm. For the lower 
points each ground state has the same probability of be- 
ing included in the calculation. The line represents a fit to 
o"i = cToo + aoi""^. The extrapolation to the infinite sys- 
tem results in a^ = —0.01(1). Consequently, the width of 
distribution of overlaps appears to be zero, i.e. -Pdgl) is a 
delta-function. 



FIG. 5. Cumulant Y describing the distribution of clus- 
ter sizes as a function of L. For small system sizes L < 8 
almost all ground-state clusters have been obtained. The fig- 
ure proves that with increasing system size the ground-state 
landscape is not dominated more and more by one cluster. 
The inset shows the probability P{nc = 1) that a realization 
exhibits only one ground-state cluster as a function of L. 




FIG. 6. Distribution P{5q) for different system sizes 
L = 4, 8, 12 where Sq — q2 — q\ and gi < g2 < gs are triplets 
of absolute values of overlaps from independent triplets of 
ground states. Only triplets with gs £ [0.5, 0.6] are used. For 
an infinite ultrametric system 5g = holds. For L = 12 a 
running average was used to smooth the data to make the 
figure more readable. With increasing system size the distri- 
butions get closer to g = indicating the increasing ultra- 
metricity of the ground states. The lines are guides for the 
eyes only. The inset shows the average value of 5q as function 
of system size L. The straight line represents the function 
{5q){L) = 0.229 x L-°-^^. 



